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CHAPTER  1 
INTRODUCTION 

1.1  Motivation,  Contributions  of  the  Thesis, 
and  Organization 

The  goal  of  engineering  can  be  viewed  as  synthesis 
rather  than  analysis  for  a desired  system.  The  concept 
of  optimization  arises  naturally  in  engineering  as  an 
Indispensable  tool  of  conceptualization  and  synthesis 
Most  formulations  of  optimal  design  problems  in 
engineering  assume  that  complete  information  is  given, 
in  the  sense  that  the  system  is  operated  under  a certain 
known  condition.  The  formulation,  then,  generally  reduces 
to  a "nonlinear  programming"  problem.  In  reality,  how- 
ever, few  systems  operate  without  interaction  with  their 
environment.  A mechanical  system,  for  example,  must 
operate  over  a range  of  load  and  environmental  parameters. 
Applied  loads  on  a structure  may  act  over  a range  of 
positions  and  angular  orientations,  at  every  point  of 
which  strength  and  displacement  constraints  must  be  satis- 
fied. Operating  temperature  and  excitation  frequencies 
are  other  examples  of  environmental  parameters  that  vary 
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in  known  intervals,  over  which  performance  constraints 
must  be  satisfied.  Military  systems,  for  example,  may  be 
required  to  operate  satisfactorily  from  -^0°F  to  120°F. 

One  cannot  simply  optimize  for  a given  temperature  and 
accept  the  performance  that  occurs  at  other  temperatures. 
Rather,  performance  constraints  must  be  satisfied  at  all 
temperatures . 

To  include  the  effect  of  surrounding  systems,  a new 
formulation  is  necessary.  The  contribution  of  this  the- 
sis is  to  define  a new  problem  formulation  and  to  develop 
numerical  algorithms  to  solve  this  class  of  optimization 
problems.  The  development  is  solution-oriented,  instead 
of  being  a theoretical  characterization  of  the  solution 
of  the  problem.  The  basic  approach  rests  on  the  idea  of 
making  a series  of  approximate  problems  out  of  the  orig- 
inal problem,  by  use  of  first  and  second  variations,  mak- 
ing it  possible  to  compute  solutions  to  practical  problems 
in  an  Iterative  fashion. 

Following  a literature  survey  of  topics  and  problems, 
similar  in  nature  to  the  present  concept  of  problem  formu- 
lation, a precise  definition  of  the  problem  is  given  in 
Chapter  2.  This  is  followed  by  a review  of  certain  clas- 
sical problems  and  their  relation  to  the  present  formula- 
tion. Several  concrete  example  problems,  which  are  solved 
in  subsequent  chapters,  are  then  stated  to  make  it  clear 
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what  the  mathematical  formulation  implies.  The  mathemat- 
ical background  relevant  to  the  development  of  computa- 
tional algorithms  Is  given  at  the  end  of  Chapter  2. 

The  remainder  of  the  thesis  develops  two  computa- 
tional alrori thins  and  presents  numerical  solutions  of 
example  jroblems.  Chapter  3 presents  a first  order  algo- 
rithm, with  four  example  problems  solved.  It  is  found 
that  tills  algorithm  Is  simple  enough  to  be  implemented 
without  excessive  computational  or  analytical  complexity 
and,  when  It  is  applied  to  min-max  problems,  it  gives  a 
Justification  for  alternating  maximization  and  minimiza- 
tion procedures. 

The  main  contribution  of  Chapter  ^ lies  in  sensitiv- 
ity analysis  with  error  compensation,  which  makes  second 
order  algorithms  and  other  Interesting  hybrid  methods  of 
Chapter  5 possible.  Several  example  problems  are  solved, 
using  both  the  second  order  algorithm  and  the  hybrid 
method,  and  a comparison  is  made. 

Since  the  problem  formulation  itself  is  rather  com- 
plicated, the  algorithms  are  algebraically  complex.  Im- 
plementation of  the  algorithms  is  given  in  Chapter  6, 
where  a general  flow  chart  is  described. 

Finally,  the  last  chapter  provides  a summary  of  the 
main  contributions  and  the  difficulties  involved  in  ap- 
plication of  the  developed  algorithms. 


1.2  Literature  Survey 

Several  mathematical  programming  formulations  that 
Involve  a free  parameter  have  been  considered  in  the  lit- 
erature. Fritz  John  [1]  considered  an  optimization  prob- 
lem with  a continuum  of  constraints  and  showed  that  the 
problem  can  be  characterized  by  one  having  a number  of 
constraints  less  than  or  equal  to  the  dimension  of  the 
design  variable.  Recently,  Gehner  [2]  considered  the  same 
problem,  with  a continuum  of  equality  constraints,  and 
derived  a necessary  condition  that  is  an  extension  of  the 
Fritz  John  theorem.  He  also  studied  constraint  qualifi- 
cation to  Chebyshev  approximation. 

Minimax  theory,  which  is  closely  related  to  the 
worst  case  design  problem,  has  been  studied  by  many  au- 
thors and  has  been  applied  in  fields  such  as  matrix  game 
theory,  optimal  control  theory,  and  differential  games. 

For  a review  of  the  literature  pertaining  to  minimax 
problems,  the  reader  is  referred  to  McLinden  [3]  and 
Barry  [4],  Recently  mln-max  problems  have  received  con- 
siderable attention.  Danskin  [5l  studied  the  max-min 
problem,  using  the  directional  derivative  of  the  function 
<t»(x)e  min  f(x,y),  and  examined  several  military  applica- 
tions to  resource  allocation.  Pshenichnyi  [6]  gives  an 
extensive  study  of  necessary  conditions  for  such  extrema, 
in  a general  setting.  He  treats  functions  of  the  type 
4>  ( x ) , above,  and  applies  results  to  the  mathematical 
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programming  problem  with  a continuum  of  constraints. 

For  solutions  of  the  mlnimax  problem,  Heller  [7]  uses 
the  directional  derivative  In  an  iterative  scheme  and  de- 
fines a mlnimax  gradient  direction.  Medanic  [8]  develop- 
ed an  elimination  algorithm  in  which  he  contracts  the 
feasible  set  and  decreases  the  mlnimax  objective  function. 
Tn  this  treatment,  the  mlnimax  objective  function  was 
assumed  to  be  convex  in  the  set  over  which  minimization 
Is  carried  out. 

Bracken  and  McGill  [9]  consider  a mathematical  pro- 
gramming problem  with  optimization  problems  in  the  con- 
straints. They  develop  criteria  under  which  the  program 
is  convex. 

The  problem  that  is  treated  in  this  thesis  differs 
from  those  considered  above , in  the  sense  that  it  is 
optimal  design  oriented.  Little  emphasis  is  given  in 
the  literature  on  numerical  algorithms  to  solve  the  prob- 
lem cited  above.  The  main  emphasis  of  the  present  thesis 
Is  on  the  development  of  numerical  algorithms  for  the 
computation  of  solutions  to  practical  problems. 
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CHAPTER  2 

STATEMENT  OF  THE  PROBLEM 
2 . 1 Problem  Definition 

2.1.1  Parameters  in  the  Optimal  Design  Problem 
The  process  of  optimal  design  is  that  of  synthesiz- 
ing a system  for  the  stated  needs  and  objectives.  A phys- 
ical system  is  modeled  so  that  mathematical  analysis  is 
possible  and  the  cost  function  that  is  to  be  minimized 
is  analytically  defined.  In  this  section,  certain  para- 
meters of  the  system  are  grouped  to  provide  a model  of 
an  optimal  design  problem.  Three  groups  are  identified, 
according  to  their  role  in  the  given  system  and  in  re- 
presenting the  environment.  They  are:  design  variables 

of  the  system,  parameters  associated  with  the  interacting 
environment,  and  parameters  associated  with  the  state  of 
the  system.  These  will  be  called  "design  variables," 
"environmental  parameters"  or  "free  parameters,"  and 
"state  variables,"  respectively.  Design  variables  are 
those  quantities  that  are  to  be  determined  by  the  design- 
er to  specify  the  design  of  the  system.  Environmental 
parameters  are  quantities  that  represent  the  environment. 
The  designer  will  not  know  the  exact  condition  of  the 
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environment,  which  can  change  over  the  life  of  the  system. 
Hence,  from  the  designer's  point  of  view,  environmental 
parameters  are  uncertain  quantities.  State  variables 
are  those  quantities  that  characterize  the  state  of  the 
system  due  to  a given  environment.  The  state  of  the  sys- 
tem is  determined  by  a set  of  equations,  called  state 
equations,  once  the  design  variables  and  environmental 
parameters  are  fixed.  The  process  of  solving  the  state 
equations  is  the  analysis  part  of  design  synthesis. 

This  classification  of  variables  is  not  necessarily 
unique,  but  is  dependent  on  the  designer's  point  of  view. 
As  a particular  example,  consider  the  simple  vibration 
system  shown  in  Figure  2.  The  mass  of  each  rigid  body, 
the  geometry  of  the  system,  the  properties  of  the  spring 
and  damper,  etc.,  are  the  design  variables  of  the  system. 
The  frequencies  of  the  excitation  forces  and  their  magni- 
tudes or  directions  are  considered  as  environmental  para- 
meters. The  position,  velocity,  and  acceleration  of  each 
mass  are  the  state  variables.  An  example  of  a more  com- 
plicated problem  is  found  in  [5]. 

In  the  finite  dimensional  optimal  design  problem,  the 
three  groups  of  parameters  are  represented  as  vectors  in 
suitably  chosen  vector  spaces.  The  vectors  will  be  de- 
noted by  b,  o , and  z;  for  design  variables,  environmental 
parameters,  and  state  variables,  respectively.  The 


dimensions  of  these  vectors  will  be  denoted  by  n,  p,  and 
m,  respectively. 

2.1.2  Mathematical  Statement  of  the  Problem 
After  the  various  parameters  for  a given  system  are 
defined,  one  is  in  a position  to  state  the  design  problem 
in  mathematical  terms.  The  mathematical  model  for  the 
class  of  optimal  design  problems  introduced  here  will  be 
termed  finite  dimensional  "parametric  optimal  design,"  or 
in  short  POD.  It  may  be  stated  as  follows:  Minimize 


J = f (b ) (2.1) 

subject  to  the  state  equations 

h^(z,b,a)  * 0,  i*l,***,m;  (2.2) 

the  parametric  constraints 

max  g6(z,b,a)  <_  0,  6*1, ••*,£;  (2.3) 

ae  A 

and  the  design  variable  constraints 

ge(b)  < 0,  6*1+1, •••,£',  (2.4) 

where 

A = ( a | q^(a)  £ 0,  l*l,*‘*,r)  (2.5) 

will  be  called  the  a-constraint  set. 


It  Is  noted  that  certain  of  the  constraints  in  the 
POD  formulation  may  be  absent  for  a specific  problem,  as 
shown  by  examples  in  Section  2.3.  The  special  feature  of 
the  formulation  lies  in  the  inclusion  of  parametric  con- 
straints with  state  equations.  Otherwise,  the  problem 
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reduces  to  a nonlinear  programming  problem.  The  general- 
ity of  the  POD  formulation  is  amplified  in  Section  2.2, 

In  relation  to  other  classes  of  problems. 

2.1.3  Subproblems  and  Expansion  Procedures 

For  the  analytical  development  to  follow,  subprob- 

letnr.  are  defined  as  the  maximization  problems  given  in 

the  parametric  constraints  of  Eq . (2.3),  i.e., 

max  gg(z,b^°),  a ) (2.6) 

a c A 

subject  to 

hj(z,b^°\a)  = 0,  l»l,*«»,m,  (2.7) 

where  b^1  ^ is  an  assumed  design. 

Throughout  the  paper,  it  is  assumed  that  the  implicit 
function  theorem  can  be  applied  to  the  state  equations, 
i.e.,  3 h/3  z is  nonsingular  and  z is  determined  locally 

as  a continuous  function  of  b and  a . It  is  also  assumed 
that  gg  is  continuous  with  respect  to  its  arguements  and 
3f?^(z(b,x  ),b,a)/3b  is  continuous  with  respect  to  b.  To 
ensure  the  existence  of  the  solution  to  the  subproblem, 
the  set  A is  assumed  to  be  closed  and  bounded,  hence  com- 
pact (Section  2.^).  For  a physically  well  formulated  prob- 
lem, these  assumptions  are  not  particularly  restrictive. 

For  further  developments,  it  is  assumed  that  the  sub- 
problem has  a countable,  preferably  finite,  number  of 
solution  points.  The  underlying  idea  is  that,  for  each 
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local  maximum  point  of  the  subproblem,  a small  closed 
neighborhood  Is  considered  and  an  approximate  subproblem 
Is  constructed  with  the  set  A replaced  by  this  neighbor- 
hood. Thus,  the  newly  generated  subproblems,  called  in- 
ner problems,  replace  the  original  subproblems,  expand- 
ing the  number  of  parametric  constraints.  Formally,  the 
parametric  constraints  can  be  written  as 

max  gB(z,b^°^,o)_<0,  (2.8) 

acUj  1 

where  U^CZA  is  a closed  neighborhood  around  the  local 
maximum  point  a that  is  large  enough  to  contain  the 
neighboring  maximum  point  after  a small  change  in 

b^°)  to  b^),  but  small  enough  to  contain  only  one  local 
maximum  point.  Under  these  conditions,  it  will  be  shown 
in  Section  2.4  that  the  function  on  the  left  side  of  Eq. 
(2.8)  is  differentiable  with  respect  to  b. 

It  will  be  assumed  that  the  expansion  procedure  has 
been  applied  for  each  numerical  algorithm  that  follows. 
Hence,  the  words  "inner  problem"  and  "subproblem"  will  be 
used  interchangeably. 

2.2  Relation  to  Other  Classes  of  Problems 
The  POD  problem  formulation  generalizes  a number  of 
classical  problems.  In  this  section,  the  relation  to  these 
problems  is  studied. 
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2.2.1  Min-Max  Problem  and  Game  Theory 

In  zero-sum  two-person  game  theory,  a mixed  strategy 
1 3 sought  3uch  that  the  max -min  Is  equal  to  mln-max,  by 
randomization  [11,12,13].  Game  theory  Is  not  the  subject 
of  this  thesis,  but  If  one  knows  that  a mixed  strategy 
exists,  one  can  obtain  a solution  by  solving  the  mln-max 
problem  only.  In  general,  the  mln-max  problem;  i.e.,  a 
two  stage  problem  corresponding  to  "half"  a saddle  point 
problem;  arises  from  two  stage  resource  allocation  prob- 
lems [5]. 

"Worst  case  design"  can  be  considered  as  a game  prob- 
lem between  the  designer  and  nature,  and  can  be  formulated 
as  a mln-max  problem.  The  designer  assumes  that  nature 
will  pick  the  environmental  parameter  by  maximizing  the 
cost,  whatever  design  the  designer  chooses.  The  design 
objective  Is  that  the  designer  minimizes  this  worst  cost, 
or  loss  ceiling.  This  design  concept  is  very  conservative. 
One  may  mitigate  this  conservativeness  by  introducing  a 
suitable  probability  distribution  over  the  environmental 
parameters.  This  process  of  mitigation  does  not  disturb 
the  min-max  nature  of  the  physical  design  problem. 

Since  this  thesis  is  directed  toward  a solution  meth- 
od, the  min-max  problem  is  assumed  formulated.  In  this 
case,  the  POD  formulation  is  realized  through  introduction 
of  a dummy  design  variable,  bn+^ , 


called  an  artificial 
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design  variable  such  that  the  transformed  problem  Is  to 
minimize 

Vl 

subject  to  the  constraint 

max  + (b , a ) <_  bn+^ . • (2.10) 

a e A 

Although  the  dimension  of  the  design  variable  is  increased 

by  1 and  an  additional  subproblem  must  be  treated,  this 

approach  has  the  advantage  that  every  possible  local 

maximum  point  of  +(b,  a ),  with  respect  to  a , can  be 

retained  by  expansion  of  the  number  of  constraints,  as  in 

Section  2.1.  It  is  also  noted  that  a cost  function  of  the 

form  max  4(z,b,  o)  can  be  transcribed  by  the  same  tech- 
a e A 

nlque.  Another  notable  application  may  be  the  saddle 
point  statement  for  the  NLP  problem  given  in  Section  2.4, 
which  can  be  treated  formally  by  the  POD  algorithm. 

2.2.2  Chebyshev  Approximation 
The  theory  of  approximation  was  developed  independ- 
ently of  optimization  theory,  especially  the  theory  of 
Chebyshev  approximation.  Literature  on  approximation  the- 
ory is  voluminous,  for  example,  see  [14-22]. 

Suppose  a function  f ( a ) of  some  normed  space  C(A) 
is  given,  and  further  an  approximating  function  F(b,  a) 
depending  on  the  parameter  beB  where  B is  some  domain  set 
of  parameter  b is  given.  Then  a general  approximation 
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problem  Is:  Given  feC,  determine  the  parameter  b°cB 

such  that 

I | f-F(b°)| | < | | f-F(b) | | (2.11) 

for  all  beB.  Here  the  norm  on  C is  denoted  by  ||»||. 

If  the  norm  is  given  by  the  uniform  norm  | | f | | »max  | f ( o)|, 

o c A 

the  problem  is  called  Chebyshev  approximation  and  can  be 
restated  as:  Determine  a b°  eB  to  minimize 

max  [g(  b , a ) = |f(a)  -F(  b , a ) | ] . (2.12) 

a e A 

Usually  the  set  (F(b,o)|beB)  is  a subset  of  C.  If 
F(b,  a ) is  a linear  functional  on  B for  each  fixed  a , the 
approximation  problem  is  called  linear,  otherwise  nonlin- 
ear. Since  all  the  required  values  of  the  components  of 
b are  necessarily  finite,  the  set  B can  be  chosen  to  be 
bounded.  Furthermore,  if  B is  assumed  closed  and  F(b, a ) 
is  continuous  in  the  parameters,  there  is  a solution  [17]. 

The  study  of  approximation  problems  through  optimi- 
zation techniques  is  still  in  its  infancy,  especially  in 
the  field  of  nonlinear  Chebyshev  approximation.  In  the 
case  of  discrete  Chebyshev  approximation,  a finite  number 
of  discrete  points  are  chosen  in  the  given  region  and  the 
problem  is  relatively  simple  [14,23, 2^].  In  the  case  of 
continuous  approximation,  such  as  polynomial  and  rational 
approximations,  a few  algorithms  were  developed  by  Stiefel 
[22]  and  Remes  [16,19].  These  algorithms  are  based  on  the 
theorem  of  Chebyshev  and  are  algebraic  in  nature.  Recent 


study  of  Chebyshev  approximation,  through  optimization 
theory  [2,6,253,  gives  necessary  conditions  that  are  sim- 
ilar to  the  Chebyshev  theorem,  but  do  not  provide  a con- 
structive method  of  solution. 

Chebyshev  approximation  falls  into  the  present  formu- 
lation of  POD,  hence  the  algorithm  developed  here  can  be 
applied  easily,  regardless  of  whether  the  approximation  is 
linear  or  nonlinear. 

2.2.3  NLP  with  State  Equations  Given  Implicitly 


Using  sensitivity  analysis,  which  will  follow  in 
Chapter  ^ , an  efficient  reanalysis  of  the  state  equations 
is  possible,  particularly  if  the  state  equations  can  be 
derived  from  a minimum  principle.  The  problem  is  stated 
in  the  form:  Minimize 


by  a Minimum  Principle 


f (b ,z) 


(2.13) 


subject  to  the  constraints 
g(b ,z)  < 0, 

where  z solves  the  nonlinear  programming  problem 


( 2 . 1*1) 


min  H(b,z) 
zcP 


(2.15) 


where  Q is  a constraint  set. 
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2.3  Examples  to  be  Considered 
To  visualize  the  type  of  problems  dealt  with  in  this 
thesis,  several  concrete  example  problems  are  stated. 

After  solution  methods  are  developed,  these  problems  are 
solved  numerically  and  a comparison  is  made  with  results 
in  the  literature. 

2.3.1  Problem  of  Finite  Allocation 
The  problem  considered  here  is  a finite  allocation 
game.  This  problem  is  discussed  in  [5,8].  Suppose  a mix 
x* (x^ , • • • ,xn ) has  to  be  chosen  among  a set  of  n weapon 
systems,  given  a total  budget  , that  are  to  be  used  in 
the  possible  attack  from  n enemy  units.  Whatever  attack 
the  enemy  selects  the  damage  inflicted  on  the  enemy  from 
the  counterattack  is  to  be  maximized.  That  is,  the  enemy 
will  strike  first  with  full  knowledge  of  the  system  mix  x. 
If  the  i-th  weapon  system  can  not  attack  the  J-th  enemy 
target,  or  vice  versa,  the  residual  x.^ ' after  enemy  attack 
of  strength  can  be  assumed  given  by  the  formula: 

-TiYi 

x^  ' = x^  e 

where  y^  is  the  "vulnerability"  of  1-th  weapon  system, 
with  respect  to  i-th  enemy  attack.  This  residual  is  used 
in  the  counterattack.  The  damage  to  the  i-th  enemy  target 
is  given  by 


v^ (1-e 
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where  Is  the  value  of  the  i-th  target  and  3^  Is  the 
vulnerability  of  the  1-th  enemy  target.  Supposing  the 
total  damage  Is  obtained  by  addition  of  Individual  system 
damage , it  Is 

a ~yl  yi 
n -B.xe 

♦ (x>y)  E [ v^l  - e 11  ) . 

Since  y Is  chosen  In  full  knowledge  of  x^ , optimal  choice 
for  x ^ is  obtained  by  maximizing  min  <|>(x,y);  or  equiva- 

y 

lently  by  minimizing  max [-$( x ,y )],’ with  the  budget  restric- 

y 

t i ons 

£xi  * cb> 

hi  - Ca  - 

x t > 0,  and  y^  >_  0. 

The  two  equality  constraints  above  are  used  to  reduce 
the  dimension  of  the  variables  by  removing  xn  and  y . Here 
Xj  plays  the  role  of  a design  variable,  b^,  and  y^  plays 
the  role  of  the  environmental  parameter,^.  The  alloca- 


tion  problem  is  formulated  as  a POD  problem  as: 

Minimize 

n 

J h max[f  • = ]>  v (Tj  - 1)] 
a 1 

(2.16) 

subject 

to 

n-1 

Cb  - Zb,  10, 

(2.17) 

bj  > 0,  i=*l,***  ,n-l , 
n-1 

C -7a. >0, 
a L i — ’ 

(2.18) 

where 

a i i°>  i"1.*  * * ,n“l» 
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n-1 


and 


(2.19) 


n 


This  formulation  is  transformed  to  fit  the  POD  formula- 
tion by  introducing  an  artificial  design  variable,  as 
explained  in  Section  2.2. 


For  the  truss  shown  in  Figure  1,  one  wishes  to  de- 
termine the  cross  sectional  area  of  each  member  in  order 
to  minimize  the  weight  of  the  structure,  under  constraints 
(stress,  buckling,  and  displacement)  that  must  be  satisfied 
for  any  load  direction  a in  a given  range,  a^£a  la2‘ 

The  same  problem,  without  parametric  constraints,  has 
been  used  as  a test  problem  for  single  or  multiple  load 
conditions  [26,27,28].  The  problem  with  stress  parametric 
constraints  is  discussed  in  [29],  in  which  the  author  uses 
the  "integrated  penalty  function." 

Denoting,  the  cross  sectional  areas  as  b^,  i=l,2,3, 

2 

and  defining  moments  of  inertia  by  I^=Sb^,  one  may  state 
the  POD  problem  as:  Minimize 


2.3.2  Three  Bar  Truss  Design  Problem 


f = 10/2  b1  + 10  b2  + 10/2  b3. 


(2.20) 


subject  to  stress  constraints 


gl  = 5-105|Z;l  + z2|  - 5-103  < 0,  ) 


Z2 


Figure  1 A Three  Bar  Truss 
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g2  = 106  | z2|  - 2*10^  < 0, 


g3  = b*iu'  | z2  - zx | - 5*103  < 0, 


s 5*105  | z 
buckling  constraints 


(2.21) 


(2.22) 


(2.23) 


’b1+b3,  b1  - b^ 

’Z1 

Pcosa 

0 

b^-b^,  b^+  b2+2^2b2 

CM 

Psina 

.0. 

g||  = -10(z1  + z2)  - ir  Bb1  <_  0, 
g^  = -10z2  - w20b2  <_  0, 
g^  = -10(z2  - z x)  - w20b3  <.  0, 
and  displacement  constraints 
g?  = | zj  - 61  < 0, 

s8  E I z2^  “ 6 2 - °* 

The  state  equations,  in  matrix  form,  are 

/?.106 

(2. 2*1) 

Finally,  the  constraints  must  be  satisfied  for  any  a 
in  an  interval  [a1,o2].  Since  the  state  equations  are 
simple,  the  state  variables  could  be  eliminated,  explicit- 
ly. As  a test  of  the  POD  method,  however,  this  problem 
is  solved  with  state  equations  as  given. 

The  maximum  number  of  local  maximum  points  of  g^(a) 
is  conjectured  to  be  two.  Hence  two  values  of  a are  given 
as  estimates.  During  iterative  solution,  the  nominal  local 
maximum  points  may  approach  each  other,  showing  that  there 
is  Just  one  maximum  point.  If  this  happens,  one  of  the 
Inner  problems  is  removed. 

For  numerical  examples  that  follow,  let  0-0.07958  (cor- 
responding to  a member  of  circular  cross  section),  P - 
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4 x 10^  lbs,  and  two  load  ranges  and  displacement  con- 
straints be  considered,  as  follows:  (i)  -^5°  1 « 1 90°, 

6 1=6 2=0 .005" , and  (11)  0°  1 a 1 90° , 6 1=0 . 005" 2»0 . 00^" . 

2.3.3  Vibration  Isolator  Design  Problem 
As  a third  example,  optimal  design  of  a vibration 
Isolator,  shown  in  Figure  2,  is  considered.  The  objective 
is  to  minimize  the  maximum  displacement  of  the  main  mass 
by  attaching  a secondary  spring-mass  system.  This  problem 
is  treated  analytically  in  Den  Ilartog  [30],  with  an  infi- 
nite range  of  exciting  frequency,  and  in  [31],  for  an 
arbitrary  range  of  exciting  frequency.  In  the  latter 
treatment,  the  problem  is  solved  approximately  by  enforc- 
ing the  constraints  on  a preselected  grid  of  points  over 
the  given  range  of  frequencies. 

The  problem,  in  POD  form,  is  given  as:  Minimize 

bn+l  (2.25) 

subject  to 

g?1  2 X12(C,  f,  a)  - bn+1  < 0,  (2.26) 


where 


g. 


x2U  ,f  ,a  ) ~ XjJJi  ,f  ,Q  ) 
xiU  ,f  ,0) 


- Q < 
^max  - 


0, 

(2.27) 


A - -(a2  - f2), 


and 


C2  + D2 
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Fipure  2 


Vibration  Isolator 
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a ' * r2 , 

B = 2Ca> 

C = -uf2a2  + (a2-l)(a2-f2)  , 

D = ?£a(o £ -l  + ga‘  )• 

Here 

C = damping  ratio  (c/cc,  cc=critical  damping), 
f = ratio  of  uncoupled  natural  frequencies  of  the 
absorber  and  the  main  mass  (wn/fln), 
a = ratio  of  exciting  frequency  to  uncoupled  natural 
frequency  of  main  mass  (ai  /n  n ) , 
and  p = mass  ratio  of  the  absorber  to  main  mass  (n^/mi). 

The  variables  5=  b^  and  f*  = b 2 are  chosen  as  design 
parameters  and  a is  the  environmental  parameter.  The  coor 
dinates,  x-^  and  x . represent  the  extreme  displacements  of 
the  main  mass  and  absorber,  respectively.  The  value  Q x 
is  selected  as  the  upper  limit  for  relative  motion  of  the 
two  masses,  sometimes  called  a rattlespace  constraint. 
Design  parameter  constraints  are 


g 


3 = 


t £0, 


S - £ 


max 


£0, 


(2.28) 


gn  = 


-f  1 0, 


f - f <0 
; 1 max  - » 


and  free  parameter  constraints  are 


Ql  = 


min 


- a <_  0 , 


“ a max  — ® • 


(2.29) 


(2.30) 
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For  subsequent  calculation  y = 0.1  and  Qmax*3-0,  and 
two  ranges  of  a are  considered:  (1)  0.5  5.0  <_  1.5,  and 

(11)  0.')  < a < 1.25.  Since  the  parametric  constraints 
are  not  convex  In  o,  It  is  Important  to  keep  every  possible 
local  maximum  point.  From  physical  characteristics  of 
a 2 degree-of- freedom  system,  one  may  conclude  that  g^ 
has  at  most  two  local  maximum  points  over  any  interval  of 
a.  Hence,  two  estimates  of  local  maximum  points  are  suf- 
ficient. For  a given  range  of  a,  there  may  be  only  one 
maximum  point  at  the  initial  design  estimate.  Since  one 
may  not  account  for  the  case  in  which  a new  local  maximum 
point  appears,  it  is  important  to  have  a reasonable  de- 
sign estimate,  or  to  repeat  the  solution  with  different 
initial  design  estimate. 

2.3.^  Optimum  Damping  in  Linear 
Dynamic  Systems  [McMunn] 

Assuming  that  synchronous,  steady  state  harmonic 
forces  are  the  only  input,  an  n degree-of-freedom  dynami- 
cal system  can  be  described  by  the  differential  equations 
Mx  + Dx  + Kx  = Pe^wt  (2.31) 

where 

M,  D,  K = mass,  damping,  and  stiffness  matrices, 

respectively  (the  elements  of  D are  linear 
combinations  of  damping  coefficients), 
x = column  vector  of  coordinates , 


P = column  vector  of  forces, 


w = angular  frequency. 

The  design  concept  chosen  here  Is  to  minimize  the 
maximum  response,  over  a riven  range  of  excitation  fre- 
quencies. Design  variables  are  damping  coefficients  of 
the  system.  The  environmental  parameter  in  this  case  is 
the  excitation  frequency.  McMunn's  method  is  restricted 
to  finding  saddle  points,  whereas  the  present  treatment 
makes  no  such  restriction. 

Following  FcMunn  [32],  harmonic  motion  is  presumed  in 
the  form  x=Xe^wt.  Then  the  governing  equation  is 

T(c,id)X  = P,  (2.32) 


where 


T(c,u>)  = -u2M  + 1idD(c)  + K.  (2.33) 

If  one  excludes  systems  that  have  infinite  response  in  the 
frequency  interval,  T(c,u>)  is  invertible.  By  Cramer's 
rule , 


♦ (c  ,10  ) = 


= p2(n-l)  <c  >“) 

Pj  Q2n(c,u>)  ’ 


(2.3^) 


p 

where  p2(n-l)  and  ^2n  are  real  polynomials  in  w , of  de- 
gree 2(n-l)  and  2n , respectively;  X^  is  the  complex 
amplitude  of  the  displacement  of  the  1-th  mass;  and  P^ 

Is  the  amplitude  of  the  input  force  on  the  j-th  mass.  In 
practice,  the  explicit  form  of  4(c,w)  is  difficult  to 
attain.  Hence,  a set  of  state  equations  is  retained 
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in  the  POD  formulation,  as  follows:  Let  real  and  imagi- 

nary parts  be  separated  such  that 

T(c,«)  = T^  (c  ,u> ) + iT2(c,(u),  (2.35) 

and 

X « u - iv , (2.36) 

then  the  state  equations  are,  with  the  state  variable 
z = (u  ,v}  , 


'T1  T2 

ru 

Y 

c 

>T2  -Tl- 

lv. 

,0. 

and  the  objective  function  is  given,  in  terms  of  the  state 
variable  2,  as 

♦ (z)  * [Ul2  + v12]/Pj 2.  (2.38) 

It  is  noted  that  <t»(c,u>)  >_  0 and  lim  $(c,u>)  0.  Hence, 

0)*4-  W 

the  case  of  an  infinite  range  of  frequencies  can  be  safely 
replaced  by  a finite  interval  of  frequencies  such  that  the 
w-constraint  set  A is  closed  and  bounded. 

The  problem  of  optimum  damping  may  now  be  formulated 
as:  Minimize 

max  $ ( z)  (2.39) 

u> 

subject  to  the  state  equations,  Eqs . (2.37)  and  the  design 
variable  constraints  c^  >_  0.  To  fit  the  POD  formulation, 
an  artificial  design  variable  bn+^  Is  introduced,  as  de- 
scribed in  Section  2.2.1. 


The  following  numerical  example  is  taken  from  McMunn 
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Ml  = 


m2 


= 0.250 


w2 


ITl*^ 

fn  2 


mji 

~ = 0.150 

m2 


8 = _L  = 13.40 

r 


0^=  (k^/m^)/w^o^  = 1.64 


a * w/a>;i0 


kj+k 

v m2 


(k3+k 

m3 


i)/u> 

5)/w 


2.18 

80.8 


C1  = ci/(2,/lciml ) = bi 
C2  = c2/(2/(k2+l<i4)m3)  = t>2 
= c ( 2 / ( k2+k^ ) m^ ) - 


Flrure  3 A Five  Dep.ree-of-Freedom 
Vehicle  Model 


A 
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[32]:  The  system  to  be  designed.  Figure  3,  is  a five  de- 

gree-of-freedom  model  of  a vehicle  traveling  on  a sinusoi- 
dal road.  The  dimensions  of  the  vehicle  and  the  magnitudes 
of  masses  and  spring  constants  are  the  same  as  in  [32], 
and  shown  in  Figure  3.  The  parameters  m^ , c-^,  and  de- 
pict the  driver  and  seat  attached  to  the  main  body,  denoted 
by  mass  m^  and  a moment  of  inertia  I^m^r^.  The  parameters 
m^  and  m^  are  the  masses  of  the  wheels,  axles,  and  associ- 
ated mechanism  of  the  front  and  the  rear  of  the  vehicle, 
while  and  k^  represent  tire  stiffnesses.  In  the  pre- 
sent example,  the  system  is  excited  by  a synchronous  har- 
monic displacement  of  the  base,  and  the  cost  function  is 
taken  as  the  square  of  the  ratio  of  the  amplitudes  of  m^ 
and  the  base.  The  dynamic  equations  may  be  written  in 
terms  of  dimensionless  parameters,  as  given  in  [32].  Nu- 
merically reduced  equations,  after  substituting  values  of 
the  parameters,  are  given  in  Appendix  A. 

2.3.5  Bridge  Design  Problem 
As  a more  realistic  test  of  the  POD  formulation, 
design  of  a bridge  is  considered,  under  load  by  a vehicle 
passing  from  right  to  left . The  bridge  is  composed  of  a 
truss  structure  over  a beam  element.  For  structural  anal- 
ysis, the  truss  structure  is  modeled  by  15  elements,  as 
shown  in  Figure  4a.  The  beam  element,  to  be  supported  by 
the  truss,  Is  shown  in  Figure  4b.  The  vehicle  is 
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a.  Truss  Structure 


Figure  ^ A Bridge  Structure 


29 


represented  by  three  point  loads  applied  to  the  beam,  at  a 
distance  a from  the  left  end.  The  design  objective  is  to 
determine  the  cross  sectional  area  of  each  truss  member 
and  the  stiffness  of  the  beam  element  to  minimize  weight 
of  the  structure,  under  certain  constraints.  For  simplic- 
ity, only  the  stress  and  displacement  constraints  will  be 
considered,  assuming  static  loading.  The  environmental 
parameter  is  the  location  of  the  vehicle  on  the  bridge,  «. 
The  state  equations  for  the  system  are  derived  in  Appen- 
dix B,  where  the  state  variables  are  composed  of  general- 
ized displacements  and  the  generalized  forces  acting  at 
the  Interacting  boundary  between  the  truss  structure  and 
the  beam  element.  As  is  usually  the  case  with  structural 
design  problems,  the  state  equations  are  linear  in  the 
state  variables,  with  the  form, 

K(b)z  = F(a), 

where  the  matrix  K is  a function  of  the  design  variables 
only.  The  linear  nature  of  the  equations  yields  computa- 
tional savings,  since  it  is  possible  to  solve  the  system 
of  equations  for  the  parametric  constraints,  where  o as- 
sumes different  values,  only  once  for  each  outer  itera- 
tion. If  the  dimension  of  z is  small,  an  explicit  inver- 
sion of  K gives  less  programming  effort.  For  other  prob- 
lems, such  as  the  one  given  in  Section  2.3.1**  the  coef- 
ficient matrix  is  a function  of  the  free  parameter  w. 
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.is  well  as  the  design  variable  c. 

Stress  constraints  for  the  truss  members  are  repre- 
sented by 

a < a < a ( 2 . 4 0 ) 

c — — T 


where  the  axial  stress  a Is  obtained  as  explained  in 

Appendix  B and  o and  o,„  are  the  yield  stresses  for 

c 

compression  and  tension.  For  the  beam  element,  a moment 
constraint  of  the  following  type  is  considered; 


M(x  )< 


(2.41) 


where  M(x)  is  the  bending  moment  along  the  beam,  and 
M « OyS  is  the  yield  moment.  The  safety  factor  SF  is 
chosen  as  1.85  and  the  section  modulus  S is  chosen  as 
S=0.58- I3/\ 

The  objective  function  assumes  the  form, 

15 

J = f p . A L + p Ad,  (2.42) 

t * i i i o o 

where  p^  , , and  A^  are  the  specific  weight,  the  length, 

and  the  cross  sectional  area  of  i-th  member  of  the  truss, 
respectively.  The  parameters  pQ,  d,  and  Aq  are  the  spe- 
cific weight,  length,  and  cross  sectional  area  of  the 
beam.  In  the  computation,  Ao=0.58*I  ' is  used  and  , 

A,, , • • • , A^  , and  the  moment  of  inertia  I are  chosen  as  de- 
ni gn  variables,  assuming  a geometrical  symmetry  of  the 


structure . 
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2_.JJ  Mathematical  Preliminaries 
In  the  field  of  nonlinear  programming,  a vast  amount 
of  literature  is  available.  The  following  texts  are  cited 
as  general  references:  [12,25,33-37].  For  future  refer- 

ence, some  concepts  and  definitions  needed  for  develop- 
ment of  a POD  algorithm  are  summarized  here. 

2 . . 1 General  Philosophy  of  Iterative  Methods 
It  has  been  observed  that  an  analytical  solution  to 
an  optimization  problem  is  practically  impossible.  Most 
of  the  literature  on  computational  techniques  use  itera- 
tive methods  and  obtain  a local  solution  to  the  optimiza- 
tion problem.  The  basic  philosophy  of  any  iterative  meth- 
od is  to  generate  a sequence  of  nominal  solutions  from  an 
estimated  point,  such  that  the  sequence  converges  to  a 
limit  point  or  a desirable  point  that  satisfies  certain 
conditions.  Two  basically  different  points  of  view  are 
possible,  depending  on  how  the  designer  improves  his  nom- 
inal design.  The  first  point  of  view  is  indirect.  It 
seeks  a solution  of  necessary  conditions  that  must  be 
satisfied  at  a local  solution  point.  The  second  point  of 
view  is  direct,  in  the  3ense  that  the  designer  tries  to 
Improve  the  design,  using  the  local  nature  of  the  problem 
around  the  nominal  point.  Most  of  the  iterative  methods 
for  solving  a nonlinear  programming  problem  are  a combi- 
nation of  the  two.  In  the  second  point  of  view,  an 
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approximate  problem  Is  generated  from  the  original  problem, 
through  function  approximations,  usually  with  a tangent 
hyperpiano  at  the  nominal  point.  The  approximate  problem 
Is  then  solved  using  necessary  conditions. 

2.^.2  Definitions  and  Theorems  for  NLP  Problems 

Important  definitions  and  theorems  are  described  for 
the  following  nonlinear  programming  problem  (NLP): 

Ml nlmlze 

f(x)  (2. H3) 

subject,  to  constraints 

g(x)  < 0,  (2.M) 

and 

h(x)  = 0,  (2.H5) 

where  xeRn,  g is  an  l-dimenslonal  vector,  h is  an  m-dimen- 

3lonal  vector,  and  m <_  n. 

A point  xeRn  that  satisfies  all  the  functional  con- 
straints is  said  to  be  feasible . The  set  of  all  such 
points  is  called  the  constraint  set  and  will  be  denoted 
by  D.  The  following  definitions  are  often  referred  to  in 
later  chapters.  An  Inequality  constraint  g^(x)  < 0 is  said 
to  be  active  at  a point  x if  g^CxJ^O  and  inactive  at  x if 
g^x)  < 0.  By  convention,  each  equality  constraint  is 
considered  active  at  any  feasible  point.  This  definition 
is  of  rather  theoretical  Interest,  since  in  numerical  anal- 
ysis one  rarely  satisfies  the  equality.  Hence,  the 
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following  concepts  are  more  useful  for  numerical  develop- 
ment. Given  a point  xeRn  and  a real  number  e 0,  the 
Inequality  constraint  is  said  to  be  c -active  at  x if 
g^(x)  >_  -e  , and  inactive  otherwise.  All  equality  con- 
straints will  be  considered  c -active.  An  e -active  Index 
set  I£  at  x is  defined  as  I£(x)*{i|gi  is  e -active).  Here, 
intentionally,  the  indices  of  the  equality  constraints  are 

not  included  in  the  set  I . The  usefulness  of  this  defi- 

c 

nition  is  illustrated  in  Chapter  6.  The  Index  set  I is 
used  to  denote  I when  e=0. 

The  existence  of  a solution  to  NLP  is  guaranteed  by 
the  following  theorem  [33,3*0:  If  f(x)  is  continuous  on 
D and  D is  closed  and  bounded  in  R°  (compact  for  a more 
general  space),  then,  f(x)  has  a minimum  (and  a maximum) 
in  D. 

For  NLP  without  equality  constraints,  a vector  d is 

said  to  be  a feasible  direction  at  xcD  if  there  is  a 

B >0  such  that  x+0d  e D for  all  0,  0^0  £ 0.  The  set 

of  directions  r = {d|deRn,  x+0d  cD  for  some  0 ) is  called 

the  set  of  feasible  directions  for  xeD  and  is  a cone.  The 

set  r is  a convex  cone  if  the  set  D is  convex.  For  a 
x 

definition  of  convexity  and  cone,  see  Appendix  C.  For  a 
set  of  linear  equality  constraints,  this  definition  could 
still  be  applied.  For  more  general  equality  constraints, 
the  concept  of  tangent  direction  is  Introduced  [38]- 
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In  the  following,  the  functions  f,  g,  and  h are  as- 
sumed once  differentiable.  At  a feasible  point  xq,  the 
first  order  constraint  qualification  is  said  to  hold  if 

every  feasible  direction  at  x is  tangent  to  a once  dlf- 

o 

ferentiable  arc  (a  directed  curve)  emanating  from  x0  and 
contained  in  the  constraint  set.  Roughly,  the  first  order 
constraint  qualification,  or  regularity  condition,  is  said 
to  be  satisfied  if  a small  move  along  any  feasible  direc- 
tion must  leave  the  point  still  in  the  constraint  set. 

To  identify  the  class  of  constraints  that  satisfy  this 
condition  at  xQ,  the  following  theorem  is  cited;  the  first 
order  constraint  qualification  holds  at  a feasible  point 
xQ  If  the  gradient  vectors  of  the  active  constraints  are 
linearly  independent.  Such  a point  will  be  called  a regu- 
lar point  of  the  constraint  set.  At  a regular  point  xQ, 
a tangent  subspace  is  defined  by  the  set  M»{y | { Vg^ (xQ ) , 
id,  vh(xQ) } *y=0}  , where  y Is  an  |l|+m  <_  n dimensional 
vector.  |l|  is  the  number  of  elements  in  the  set  I. 

It  is  obvious  that  if  at  a point  there  is  a direction 
that  does  not  lead  out  of  the  constraint  set  and  along 
which  the  objective  function  decreases,  then  such  a point 
can  not  be  a minimum  point.  Based  on  this  observation, 
a necessary  condition  for  a regular  point  xq  to  be  a local 
minimum  point  is  stated:  The  gradient  vf  of  the  objective 

function  is  orthogonal  to  the  tangent  plane.  That  is. 
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vr  is  a linear  combination  of  the  gradients  of  active  con- 
straints. Stated  differently,  the  projection  of  the  grad- 
ient vf  onto  the  tangent  plane  is  zero.  More  precisely, 
the  following  Kuhn-Tucker  Theorem  is  stated  [33]:  If  xQ 

is  a relative  (local)  minimum  point  for  NLP  and  is  a regu- 
lar point  for  the  constraints,  then  there  exists  a vector 
Ac  Ft"1  and  a vector  pcR1,  with  y ^ 0,  such  that 

VL(xq,  A,  g)  »0,  (2.46) 

and 

M1K1(x0)  . 0,  (2.117) 

where 

L(x , A,  y)  » f(x)  + XTh(x)  + yTg(x)  (2.48) 
is  called  the  Lagrangian.  The  vectors  y and  A are  called 
Lagrange  multipliers,  corresponding  to  the  Inequality  con- 
straints and  equality  constraints,  respectively. 

According  to  the  Kuhn-Tucker  theorem,  the  Lagrangian 
functional  is  stationary  at  xq.  If  the  regularity  assump- 
tion on  xq  is  omitted,  one  can  only  conclude  that  the 
functional  AQf (x )+ATh(x)+yTg(x ) is  stationary.  If  xQ 
is  regular,  Aq  may  be  chosen  as  one  and  the  optimization 
problem  is  said  to  be  normal  [37].  If  xq  is  not  a regular 
point,  then  ^=0  and  the  problem  is  abnormal . 

Assuming  that  functions  in  NLP  are  twice  differenti- 
able, one  can  show  that  the  Hessian  matrix  of  second 
partial  derivatives  of  the  Lagrangian  with  respect  to  x 
is  positive  semidefinite  on  the  tangent  subspace  of  the 
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active  constraints  at  x [34].  This  i3  called  second  or- 

o 

der  necessary  conditions.  If  the  Hessian  matrix  is  posi- 
tive definite,  then,  this  strengthened  condition,  combined 
with  Kuhn-Tucker  conditions,  constitutes  a second  order 
sufficient  condition  for  x to  be  a strict  relative  mini- 


2.4.3  Approximations  of  the  Problem  NLP 
As  stated  at  the  beginning  of  this  section,  an  itera- 
tive method  is  established  by  first  forming  an  approximate 
problem,  using  Taylor  series  expansions.  If  second  and 
higher  order  terms  are  deleted,  the  approximation  is  lin- 
ear. If  third  or  higher  order  terms  are  deleted,  one  has 
a second  order  approximation.  The  most  common  approxima- 
tion around  x is  first  order. 


f(y)  - f(x)  » 1 (y  - x), 

dx 


(2.49) 


where  ||y-x||  is  small  enough  that  the  higher  order  terms 
are  negligibly  small.  The  left  hand  side  of  Eq.  (2.49) 
is  denoted  fif(x)  and  (y-x)  is  denoted  fix.  These  quan- 
tities are  called  variations.  Hence, 

fi  f ( x ) = fix  + 0(fix2),  (2.50) 

where  0(x)/|x|  <_  K for  small  x for  some  constant  K. 

Similarly,  a variation  of  f up  to  second  order  is  express- 
ed by 


6 f (x ) * f-(-X-}fix  + 0(fix3),  (2.51) 

dx  2 ,v2 
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where  6x  has  same  meaning  of  a finite  variation.  In  the 
following  studies,  the  remainder  terms  for  the  expressions 
of  variation  of  f will  be  omitted,  with  the  understanding 
that  | 1 6x  | | is  small  enough  so  that  the  expansion  has 
negligible  higher  order  terms. 

2 . 4 Gradient  Projection  with  Constraint 
Error  Compensation 

The  first  order  expanion  is  described  here  to  solve  a 
NLP.  The  method  is  called  a "gradient  projection  method 
with  constraint  error  compensation"  [33] » since  the  direc- 
tion of  movement  is  defined  as  the  vector  sura  of  a projec- 
tion of  the  negative  gradient  onto  a subspace  and  another 
vector  that  compensates  any  constraint  error  at  the  cur- 
rent point.  The  following  result  is  derived  from  the  Kuhn- 
Tucker  necessary  condition,  applied  to  the  first  order 
approximate  problem.  The  approximate  problem  is  of  the 
form:  Minimize 

6 f = ijT6b  (2.52) 

subject  to 

T 

6g  » l*  6b  <_  Ag,  (2.53) 

where  and  are  gradients  of  f and  g in  the  design 
space,  i.e.,  when  equality  constraints  or  state  equations 
are  involved,  the  state  variables  are  locally  eliminated. 
The  particular  form  of  these  gradients  is  derived  for  each 
problem  in  the  following  chapters.  The  quantity  Ag  is  the 
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desired  reduction  in  the  current  constraint  violation. 

The  solution  of  the  above  approximate  problem  can 
result  in  a large  fib,  so  the  linear  approximation  would 
no  longer  be  valid.  Hence,  a stepsize  restriction  is 
imposed  on  fib;  namely: 

fibTWfib  < n2,  (2. 5*0 


where  n is  a small  constant  and  i is  a positive  definite 
weighting  matrix.  The  choice  of  W and  n is  based  on 
computational  skill,  suggestions  for  which  are  given  in 
Section  6.3.2.  Also,  since  this  iterative  method  is  local 
in  nature,  around  the  current  nominal  design,  the  inequal- 
ity constraints  that  are  inactive  are  not  of  interest. 
Therefore,  the  matrix  of  gradients  contains  only  columns 
associated  with  active  constraints.  With  this  formulation, 
the  solution  of  the  Kuhn-Tucker  necessary  conditions  for 
the  local  problem  is  [333: 


fib  - - UJ  - (2.55) 

A = -M^"1  U*TW-1JlJ  + 2YAg),  (2.56) 

where 

T 

Mh  = i*  W"1**,  (2.57) 


and  X and  Y are  multipliers.  A choice  of  y,  in  relation 
to  r>,  is  suggested  in  Section  6.3*2. 

Instead  of  the  direct  inversion  of  matrix  M^,  the 
following  scheme  is  used  in  computation.  Let 
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b2 


Fipure  5 Gradient  Projection  Method 
with  Constraint  Error  Compensation 
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A=A^-2yA^,  (2.58) 

where 

T 

M^A1  = -t*  wV,  (2.59) 

and 

M^A2  = Ag.  (2.60) 

Then , one  has 

6b  » — (tJ  + A 1 ) + W-1i^ A ^ . (2.61) 

2y 


Putting 


«b  - - sb  ♦ «b2. 

(2.62) 

2y 

where 

6b1  « VT1(1J  + i^A1) 

(2.63) 

6b2  » W-1l*A2, 

(2.64) 

one 

can 

verify  the  relations  [39,40]: 

T 

(1) 

6b2  tttb1  = 0, 

(2.65) 

(2) 

1*  6b1  = 0, 

(2.66) 

(3) 

6b^  = Ag, 

(2.67) 

T 

(4) 

-ld  6 b1  < 0. 

(2.68) 

The 

geometrical  situation  is  shown  in  Figure  5, 

in  a two 

dimensional  design  space  with  one  active  constraint. 


2.4.5  Analytical  Properties  of  Max-Value  Functions 

Recently,  a number  of  authors  [5,6,41]  have  studied 

functions  of  the  type  u(x)=max  <j>(x,a)  and  have  applied 

o 

their  results  to  solution  of  practical  problems  such  as 
mathematical  programming  with  continuum  of  constraints 
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and  the  theory  of  best  approximation.  The  distinguishing 
feature  is  that  the  function  w(x)  is  not  differentiable, 
in  general,  but  is  only  quasi-dif ferentiable , under  mild 
assumptions.  In  the  remainder  of  this  section,  relevant 
properties  of  the  function  u(x)  are  summarized,  mainly 
from  Pshenichnyi  [6] . For  definitions  of  basic  terminolo- 
gies in  functional  analysis,  see  Appendix  C. 

For  a bounded  convex  functional  ♦ (x),  x in  a Banach 
space  B,  i.e.,  a convex  functional  that  is  bounded  above 
on  every  bounded  region  D,  the  set  of  support  functionals 
M(xQ)  to  ♦(x),  at  xQ,  is  defined  by 

M(x  )■{  x*|  x*eB*  , <j>  (x)-$  (xn)>x*(x-x  ) for  all  xeB}, 

o 1 ° — o Cn\ 


where  B*  is  the  normed  dual  of  B.  It  is  shown  in  [6]  that 
M(xq)  is  convex,  weak*  closed,  and  bounded.  The  term  "sub- 
differentials,,  of  $(x)  at  xQ  has  been  used  for  the  set  of 
support  functionals  by  Rockafellar  [41],  If  $(x)  is 
Gateaux  differentiable  at  xq,  M(xQ)  is  simply  the  single 
functional  xQ*,  the  Gateaux  differential  of  *(x)  at  xQ. 

The  directional  differential,  defined  by 

♦ (xQ+Xe ) - ♦ (xQ) 


(2.70) 


■=  lim 

3e  X-^  + 0 X 

is  given  by  the  formula  [6] 

~ = max  x*(e)  (2. 71) 

3e  x*eM(x  ) 
o 

for  all  xQ  and  e.  Motivated  by  this  result,  a broader 
class  of  functionals  is  defined.  A functional  is  said 


to  be  quasi-differentiable  at  xq  if  there  exists  a convex, 

weak*  closed  set  M(x  ) such  that  Eq.  (2.71)  holds.  The 

o 

class  of  Gateaux  differentiable  functionals  and  bounded 
convex  functionals  are  in  the  class  of  quasi-differentiable 
functionals . 

Now  consider  the  function 

m(x)  = max  <(>  ( x ,a  ) (2.72) 

ae  A 

where  A is  a closed  and  bounded  subset  in  a Euclidean 
space.  For  convenience,  define  the  "answering  set"  [5] 
at  x , 


A(x  ) = { a | ♦(x,a)»y(x)}.  (2.73) 

If  $(x,a)  is  a functional  that  is  continuous  in  x and  o, 
where  x is  in  a Banach  space  B and  oeA,  then  m(x)  is 
continuous.  Moreover,  let 


*(x0+Ae,o  W(xQ,a)  + xS*.(*P>q),  + Ay  ( A ,a  ) , 

v 0 

for  A>0,  where  y(  A, a )-*■()  uniformly  in  a as  A-*-+0. 
Then,  w(x)  is  differentiable  in  the  direction  e and 

3 ♦ (xQ,a  ) 


9u  (x0  ) 


— = sup 

3e  aeA(xo)  3e 


(2.74) 


Furthermore,  if  4>(x,o)  Is  quasi-differentiable  at  xq,  for 

every  a,  then  v(x)  is  quasi-differentiable  at  xQ,  with 

M(xJ-coU  M(x  ,a ) , (2.75) 

0 ae  A(x  ) 0 


where  M(xQ,a)  is  the  set  of  support  functionals  to  $(x,a) 
at  x , M(x  ) is  the  set  of  support  functionals  to  u(x) 
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at  xq,  and  co  K denotes  the  weak*  closure  of  the  convex 
hull  of  K [6]. 

Existence  of  the  directional  derivative  and  its 

properties,  such  as  the  continuity  of  the  directional 

derivative  when  A(x)  is  composed  of  a single  point,  are 

discussed  in  Danskin  [5].  For  future  reference,  an 

important  theorem  is  cited:  If  $(x,a)  is  continuous 

34 (x  0 ) 

in  x and  a,  and  if  — =— ■ 2 — - is  continuous  with  respect 

O 

to  x,  then  u(x)  is  differentiable  in  any  direction  e at 
any  point  x and 


IhJL*-)  = max 

3e  S?A(x)  3e 


(2.76) 

If  A(x)  consists  of  one  point  a(x)  only,  then  p(x)  is 
continuously  differentiable, 

(2.77) 

and  a ( x ) is  continuously  dependent  on  x [5,6]. 


3n(x)  _ 34 (x  ,a ( x ) ) 

3X  3X 


2.H.6  Theory  of  Parametric  Nonlinear  Programming 
Consider  the  problem  of  minimizing  a continuously 
differentiable  function  f(x)  subject  to  the  constraint 


u(x)  = max  g( x ,a ) _<  0, 
ac  A 


(2.78) 


where  g(x,a)  is  continuous  with  respect  to  a and  x and  has 
a 

theorem  cite!  above,  u(x)  is  quasi-dif ferentiable  with 
the  set  of  support  functionals  given  by 


continuous  gradient  — xeR11.  According  to  the 

3 X 
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I | 3g(x0,a) 

M(x  ) = co  ( [J  ) 

0 aa(xj  3X 


(2.79) 


It  can  be  shown  [6]  that  the  necessary  condition  for  x to 

o 

be  the  minimum  point  is  that  there  exist  nonnegative  con- 
stants and  X,  not  both  zero,  such  that 


3 f ( Xq ) 
3 X 


+ X C = 0 


(2.80) 


and 


Xu (xQ)  = 0 , 


where  ceM(xQ).  From  Eq  . (2.79),  and  Caratheodory  ' s the- 
orem [41],  the  vector  c can  be  represented  in  the  form, 
n+1  3g(xQ,a1) 


l 


1=1 


3 X 


(2.82) 


where 


n+1 


■ j_  c A(xq)  , x ^ >_  0,  £ x ^ - 1 


Hence  a necessary  condition  for  x to  be  a solution  to  the 

o 

above  problem  is  that  there  exist  constants  X^O  and  y^O, 
not  all  zero,  and  points  e A(xQ),  i=l,***,n+l,  such 

that 


3 f(xQ)  n+1  3g(x0,ai) 


3 X 


l 


1 


= 0. 


(2.83) 


i-1  ' 3X 

Furthermore,  if  f(x)  and  g(x,a)  are  convex  functionals  for 
each  a and  if  p ( x ^ ) < 0 for  some  x-^  (interior  point  condi- 
tion), then  it  is  necessary  and  sufficient  that  there  exist 
c A(xa),  i*l,**»,  n+1,  such  that  xQ  is  a solution  to  the 
following  problem 
min  f(x) 


(2.84) 


subject  to 
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g(  x ,a  ^ ) <_  0,  i*l,***,n+l.  (2.85) 

This  result  is  very  similar  to  the  Fritz  John  Theorem 
L 1 J , which  states  that  at  most  n a^'s  are  sufficient  to 
characterize  the  solution  of  the  original  continuum  prob- 
lem by  a discrete  problem  with  at  most  n equality  con- 
straints. If  the  above  result  is  applied  to  the  Chebyshev 
approximation  problem  discussed  in  Section  2.2,  the  funda- 
mental theorem  of  Chebyshev  approximation  is  obtained  [6]. 

While  the  Justification  of  the  assumptions  is  often 
difficult,  certain  continuity  assumptions  can  safely  be 
made  in  practice.  For  the  following  development  of  numer- 
ical techniques,  let  g(x,a)  be  continuous  in  x and  a, 
where  xe  Rn  and  aeR*3,  and  let  ~ con^inuous  x* 

Then,  from  the  above,  u(x)=  ma^  g(x,a)  is  directionally 
differentiable,  where  A is  a closed  bounded  set.  Also, 
there  exist  points  a^,  i*l,***,n+l,  in  A(xQ)  that  charac- 
terize the  original  problem.  The  difficulty  with  the 
problem  at  hand  is  that  the  points  a^,  i=l,***,n+l  are 
not  known  beforehand  and  the  numerical  procedure  that 
follows  is  very  much  dependent  on  how  these  points  are  ob- 
tained. As  observed  in  practical  problems,  it  will  be 
assumed  that  the  answering  set  A(x),  for  each  x,  consists 
of  a finite  number  of  isolated  points,  a^,  i*l,***,s,  such 
that  it  is  always  possible  to  have  a closed  neighborhood 
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U^,  corresponding  to  in  A(x),  disjoint  from  each  other. 
Thus,  the  expansion  procedure  discussed  in  Section  2.1  is 
realizable.  The  expanded  form  of  the  problem  is, 

min  f(x)  (2.86) 

subject  to 

u.(x)  r max  ♦ (x  ,a ) <_  0,  i*l,***,s,  (2.87) 

1 aeU1 

where  ll^C  A . 

In  this  case,  it  is  evident  that  the  answering  set  U^x) 
for  u^(x)  is  composed  of  a single  point  o^(x),  where 
a^(x)  is  continuous  in  x and  p^(x)  is  in  the  class  of 
continuously  differentiable  functions,  making  it  possible 
to  apply  the  theory  of  nonlinear  programming.  These  fea- 
tures are  utilized  implicitly  in  the  numerical  algorithms 
that  are  developed  more  formally  in  the  following  chapters. 
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CHAPTER  3 

A FIRST  ORDER  ALGORITHM  FOR  THE  POD  PROBLEM 
3.1  Introduction 

Iterative  algorithms  for  design  improvement  can  be 
based  on  varying  degrees  of  precision  of  approximation  of 
the  problem.  In  this  chapter,  first  order  approximations 
will  be  used  and  a "first  order"  algorithm  will  be  devel- 
oped. The  basic  idea  in  the  development  of  the  algorithm 
is  to  determine  what  constraints  the  inner  problems  place 
on  allowable  variations  of  the  design  variable.  Once  this 
information  is  available,  one  can  apply  steepest  descent 
or  other  iterative  design  techniques.  In  the  following, 
an  algorithm  based  on  the  gradient  projection  method  de- 
scribed in  Section  2.4,  is  given. 

3.2  A First  Order  Algorithm  by  Gradient  Projection 
Assuming  that  the  conditions  given  in  Section  2.1.3 
are  satisfied,  the  procedure  will  be  as  follows: 

(1)  Estimate  b^^,  solve  the  inner  problems  and  de- 
note the  solutions  by  the  vectors  o and  z . When 

8 p 

solutions  of  an  inner  problem  corresponding  to  the  same 
parametric  constraint  approach  each  other,  one  inner  prob- 
lem must  be  removed.  Thus  a "merge"  check  for  the  local 
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maximum  points  is  necessary. 

(2)  Check  the  constraints  g^  (z^  ,b^^  ,cT^ ) £ 0. 

(3)  Define  the  index  set  I£  = (i|g^  >_  -e). 

(4)  Consider  g^,  ie Ie . For  perturbations  fib  around 
b^®\  perturbations  of  <T  and  z must  satisfy, 

max  [r— =■  6z  + — ^ fib  + r— ^fio]  £fig  (3.1) 

O Z 3 U ofl  1 

subject  to 

fih  - fiz  + fib  + ««  - 0.  (3.2) 

and 

fi  q «=  fia£  0,  (3.3) 

where  derivatives  are  calcualted  at  a^,  z^,  and  b^^.  The 
quantity  sg^^  is  the  desired  reduction  in  constraint  viola- 
tion, usually  taken  as  &g4=  -g1(z,b^^  ,a  ) . This  linearized 
subproblem  may  be  viewed  as  a restriction  on  the  variation 
fib,  which  must  be  made  more  explicit  for  calculation  of 
solutions . 

Since  a and  z solve  the  inner  problem  of  Eqs.  (2.2) 
and  (2.3),  with  b ^ ^ fixed,  the  Kuhn-Tucker  necessary  con- 
ditions (See  Section  2.4)  must  be  satisfied: 


8Li  3gi  T 

3q 

— + V1  — , 

(3.  ^ ) 

3a  3a 

3 a 3a 

3L  *g4  m 

3h 

— -L  . 0 ■ - r— 1 + kT 

— 

(3.5) 

3Z  3 z 

3 z3 

Wiqi  = °»  iBl  »’  * * >r 

y 

(3.6) 

u±  > 0,  i-l,« • • ,r 

(3.7) 

h(z,b,a)  - 0, 

(3.9) 
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where 


Hence , 


and 


*j_  * + k h + v q. 


!£i 

3a 


6a 


, T 3b  . T 3 q N 
(l<  + 11  9T){0 


(3.9) 

(3.10) 


3 Z 


T 3h  T,3b  3h  . , , . 

6 z = k - — 6 z « -*c  ( —^6  b + — — $ a).  (3*11) 

3 Z 3b  3a 


Therefore,  the  expression  in  brackets  in  Eq.  (3.1)  Is  sim- 
plified to: 

6El  = (3^1  " *T  fb)6b  + yT  3^  6a»  (3.12) 

so  that  explicit  dependence  on  6 z has  been  eliminated. 

The  linearized  POD  problem  is  now:  Minimize 


«f  « 6b  (3.13) 

subject  to 

max  [yT  ^a]  < -(^^  - KTrr-)5b  + » (3.14) 

6a  3a  — 3b  3b  i 


8q 

— 6a  < 0 
3o 

y > 0 . 

T 3 q 

The  two  inequalities  above  require  that  y — h 5a  <_  0,  so 

3 a 

T a q 

max  y 2-i  6a  <0.  However,  the  maximum  value  of  zero  can 
6 a 3a  ~ 

be  achieved  by  6a  = 0.  This  observation  eliminates  explicit 
dependence  in  the  linearized  problem  on  6a , so  the  con- 
straint on  the  design  variable  is  written  only  in  terms 
of  the  design  variable.  The  linearized  problem  of  Eqs. 
(3.13)  and  (3.14)  now  becomes  simply:  Minimize 


(3.15) 
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6 f 


3f 

3b 


6b 


subject  to 

(3"tT  “ K 3b^a  ,z  6b  - Agi’  ieIe>  (3.16) 

m i i 

where  < i3  given  from  Eq . (3.5). 

With  6b  solved  from  this  approximate  problem,  an 
improved  design  is  b^  ^*b  ^^+6  b.  One  may  now  check  for 
convergence  and  terminate  or  return  to  Step  (2),  with  b ^ ^ 
replaced  by  b^  ^ . 

The  procedure  for  solving  the  POD  problem  may  now  be 
divided  into  two  independent  steps:  (1)  Solution  of  sub- 

problems,  and  (2)  solution  of  the  outer  problem  given  by 
Eqs.  (3.15),  and  (3.16).  Several  different  versions  of 
the  solution  procedure  are  possible,  depending  on  the 
methods  used  to  implement  these  two  steps.  Possible  ap- 
proaches will  be  discussed  in  Section  5.2.  For  Step  (2), 
the  solution  by  gradient  projection  is  exclusively  used 
in  the  algorithm. 

The  approximate  problem  obtained  above  is  exactly  the 
same  as  is  given  by  Eqs.  (2.52)  and  (2.53),  and  can  be 
readily  solved  for  a design  improvement  by  imposing  a step- 
size  restriction  on  6b,  as  in  Eq.  (2.5*0; 

6bT  W.  6b  < n2  (3.17) 

b — 

where  is  a positive  definite  weighting  matrix  and  n is 
a small  constant.  Following  Section  2.*l,  the  solution  of 
the  approximate  problem  is  obtained  as  Eqs.  (2.62),  (2.63) > 
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and  (2.64);  where 

JT  3f 

1 = ab  ’ 

ag< 


»{-- 


3b 


T 3h  . r \ 

K 3b  ’ leIc } * 


(3.18) 

(3.19) 


Ag  = {Agi,  lde).  (3.20) 

The  first  order  analysis  described  here  leads  to  a 
simple  computational  scheme  that  essentially  Justifies 
previously  used  "alternating  maximization  and  minimization 
procedures"  for  the  min-max  problem.  In  the  present  treat 
ment , no  assumption  of  a saddle  point  solution  is  neces- 
sary, as  long  as  the  functions  involved  are  once  differ- 
entiable with  respect  to  their  arguments. 


3.3  Numerical  Examples 

In  this  section,  the  first  order  algorithm  is  applied 
to  solve  four  example  problems  from  Section  2.3. 

As  a numerical  example,  for  the  weapons  allocation 
problem  given  by  Eqs . (2.16-19),  the  following  input  data 
from  Medanic  [8]  are  taken,  with  n*3:  **  1 , V2  ■ 2 , 

v3  " 3,  Vjj  * 4;  ■ 1,  B2  = 2,  63  = 2,6^-  1;  - 4, 

Y 2 * 3,  Y3  ■ 2,  Y4  = 1. 

Since  f'  in  Eq.  (2.16)  is  concave  in  a,  for  any  b,  and 
the  constrained  set  given  by  Eq.  (2.18)  is  convex,  only  one 
value  of  a is  used  as  a starting  estimate  of  the  maximum 
point.  The  initial  estimate  is  b^°^=  [0.1,  0.2,  0.3]^  and 
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a^°^»  [0.1,  0.2,  0.3]^.  Results  of  computation  for  each 
Iteration  are  3hown  in  Table  1.  The  final  result  Is 
b - [0.0,  0.188,  0.273]T,  a = [0.0,  0.182,  0.456]T,  and 
J ■ -2.234,  after  11  iterations.  The  solution  from  [8]  is 
b - [0.0,  0.1891  , 0.2942]T  and  J = -2.235,  after  22  iter- 
ations . 

In  Table  2,  the  results  for  case  (1)  of  the  3 bar 
truss  design  problem  are  shown.  At  the  optimum  solution, 
the  worst  case  was  found  to  be  the  buckling  constraint  of 
member  2,  at  load  angle  a * -45°,  and  the  z^-displacement 
constraint,  at  load  angle  o « 0.0°.  It  is  observed  that 
the  Z2-displacement  constraint  is  nearly  tight  at  load 
angle  a * 90°.  Table  3 shows  results  for  case  (li).  Two 
displacement  constraints  became  tight  at  a - 0°  and  a -90°, 
respectively.  In  Tables  2 and  3,  a is  given  in  radians. 

The  results  presented  in  Table  4 , for  case  (i)  of  the 
vibration  isolator  design  problem,  show  that  the  rattlespace 
constraint  is  strictly  satisfied  and  that  g^^  is  tight  at 
two  local  maximum  points.  Thus,  the  solution  of  this 
problem  is  the  same  as  Den  Hartog's  [30],  with  an  infinite 
range  of  exciting  frequency.  The  final  result  obtained  is 
C * 0.1697  and  f «*  0.9090,  with  xx  -4.59,  after  20  itera- 
tions. The  response  of  the  main  mass  with  this  design  is 
shown  in  Figure  6.  The  analytic  solution  from  [30]  is 
C - 0.1679  and  f - 0.9091,  with  xx  * 4.583.  The  solution 
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in  [31],  using  a grid  mesh  of  0.05,  is  K - 0.1503  and 
f **  0.9096,  with  x^  = 4.547.  For  the  excitation  frequency 
range  of  [0.9,  1.25]  In  case  (11),  results  are  shown  in 
Table  5*  The  final  result  is  f s 0.1239  and  f * 0.9536, 
with  x,  * 4.06.  Here,  g^  becomes  tight  at  two  points,  as 
shown  in  Figure  6 , and  the  rattlespace  constraint  gj  is 
tight  at  a = 0.94.  The  solution  in  [31],  using  a grid 
mesh  of  0.05,  is  C = 0.1232  and  f = 0.9524,  with  - 4.029. 

Table  6 shows  results  of  calculation  for  the  bridge 
design  problem  described  in  Section  2.3.5.  The  problem 
contains  9 design  variables,  1 free  parameter,  16  state 
variables,  and  20  inner  problems  (14  subproblems;  8 stress 
constraints  for  the  first  eight  truss  members,  5 moment 
constraints  at  three  nodal  points  and  at  two  loads  ?2  and 
P^»  and  1 displacement  constraint  at  load  P2).  The  solution 
shows  that  the  displacement  constraint  dominates  the  design. 
Convergence  was  rapid  for  the  first  few  iterations,  but  the 
compensation  of  displacement  violations  was  slow,  resulting 
in  a large  number  of  iterations.  Better  convergence  can 
be  obtained  by  a different  choice  of  the  algorithm  para- 
meters, such  as  the  stepsize.  As  in  the  other  example 
problems,  this  problem  shows  the  reliability  of  the  first 
order  method.  The  computer  time  per  iteration  on  an 
IBM  36O/65  was  about  1.7  seconds  in  FORTRAN(H). 


Table  1 Weapons  Allocation  Problem 
(First  Order  Algorithm) 


iter 

bi 

obj. 

ll«b1|| 

°i 

Ilia1!! 

tight 
6i»  9i 

0.1 

0.2 

0.3 

0 

0.1 

0.2 

0.3 

-2.10 

1.0 

0.0 

0.2*46 

0.566 

( *4 ) * . 007 

ql 

1 

0.15 

0.15*4 

0.25*4 

-2.298 

0.55 

0.0 

0.123 

0 . *4  *47 

(*4)0.008 

ql 

2 

-0.13*4 

0.237 

0.293 

-2.378 

0.17 

0.0 

0.219 

0.  *455 

(*4)0.005 

g2’  Q1  ' 

3 

0.0 

0.075 

0.3*40 

-2.280 

0.65 

0.0 

0.010 

0 . *478 

(*4)0.008 

It 

*4 

0.0 

0.199 

0.328 

-2.308 

0 . *43 

0.0 

0.197 

0.556 

(*4)0.007 

It 

5 

0.0 

0.1*48 

0.25*4 

-2.27*4 

0.20 

0.0 

0.1*47 

0.506 

(3)0.003 

II 

6 

0.0 

0.179 

0.250 

-2.2*40 

0.16 

0.0 

0.160 

0 . *4*45 

(*4)0.006 

II 

7 

0.0 

0.189 

0.262 

-2.232 

0.09 

0.0 

0.166 

0 . *4  66 

(1)0.005 

8 

0.0 

0.193 

0.269 

-2.23*4 

0.0*4 

0.0 

0.178 

0 . *452 

(2)0.00*4 

n 

9 

0.0 

0.191 

0.271 

-2.23*« 

0.0*4 

0.0 

0.l80 

0.  *453 

(1)0.003 

11 

10 

0.0 

0.190 

0.272 

-2.23*» 

0.0*4 

0.0 

0.181 

0 . *45*4 

(1)0.002 

II 

11 

0.0 

0.188 

0.273 

-2.23*4 

0.0*4 

0.0 

0.182 

0.  *456 

(1)0.001 

ft 

•Number  of  maximizations. 


vn 

Jr 


Table  2 3-bar  Truss  Design,  Case  (1)  (First  Order  Algorithm) 


Iter 

bi 

obj. 

iu^ii 

| | 6a* | | max 

tight  constraint ,gj_(a) 

0 

8.00 

2.40 

3.20 

182.39 

12.6 

(6)*. 300 

S3,  S7 , g8 

1 

8.03 

2.42 

4.61 

203.01 

11.6 

(6)0.007 

g3<-.6l) ,g7(-.l8) 

g8(-. 785) , gg(l . 571) 

2 

8.33 

2 . 31 

5.99 

225.54 

10.8 

(6)0.007 

S,(-.6l9),g7(-.H7) 
gg(l .571) 

3 

8.84 

2.09 

7.29 

249.00 

3.75 

(6)0.005 

gy (-. 072 ) ,gg(l . 571) 

4 

9.28 

1.55 

8.49 

266.54 

2.07 

(5)0.005 

g7(-.045),g8(1.571) 

5 

9.67 

1.18 

9.26 

279.52 

0.95 

(6)0.006 

g?(-. 013) ,gQ(l. 571) 

6 

10.07 

0.894 

9.77 

289.54 

0.60 

(6)0.005 

g7(-. 0043), g8(l. 571) 

7 

10.36 

0.691 

10.12 

296.56 

0.58 

(6)0.003 

g7(-.011),g8(1.571) 

8 

10.59 

0.530 

10.39 

302.10 

0.39 

(5)0.005 

g?(-. 0018), g8(l. 571) 

9 

10.83 

0.369 

10.66 

307.58 

0.41 

(6)0.003 

g7(-.007),g8(1.571) 

10 

11.02 

0.237 

10.88 

312.04 

0.25 

(5)0.004 

g7(. 0002), gQ(l. 571) 

11 

11.21 

0.105 

11.09 

316.50 

0.33 

(5)0.004 

gy(-. 008) ,g8(l. 571) 

12 

11.35 

0.00166 

11.27 

319.95 

0.20 

(5)0.003 

g5(-. 785), g7(-. 0016) 
g8(1.571) 

13 

11.25 

0.0445 

11.38 

320.42 

0.30 

(5)0.003 

g5(-.785),g7(.005) 

14 

11.33 

0.0448 

11.30 

320.43 

0.08 

(6)0.04 

g5(-. 785), g7(-. 0001) 

15 

11.32 

0.0448 

11.31 

320.45 

0.14 

(6)0.04 

g5(-.785),g7(-.005) 

16 

11.306 

0.04474 

11.321 

320.44 

0.04 

(6)0.03 

g5(-. 785), g?(. 0019) 

17 

11.309 

0.04475 

11.319 

320.45 

0.1 

(6)0.03 

g5(-.785),g7(-.005) 

ui 

ui 


Table  3 3-bar  Truss  Design,  Case  (11)  (First  Order  Algorithm) 


iter 

b! 

obj . 

1 1 « b1 1 1 

tight  constraint ,g^ 

0 

8.00 

2.40 

3.20 

182.39 

97.8 

(6)* .075 

9 By  9 Eg 

1 

8.12 

2.39 

4.60 

204.01 

73.0 

(6)0.0047 

®3’  g7’  68 

2 

8.44 

2.40 

5.99 

228.04 

49.3 

(6)0.0066 

g?(0.0) ,gg(l .571) 

3 

8.91 

2.38 

7.32 

253.35 

29.9 

(6)0.0046 

g? (0 . 0 ) ,gg(l . 571 ) 

4 

9.67 

2.32 

8.86 

285.33 

14.1 

(4)0.0045 

g? (0 . 0) ,gg(l . 571 ) 

5 

10.85 

2.15 

10.71 

326.42 

2.23 

(6)0.0060 

g7(0.0),gg(1.571) 

6 

11.295 

2.01 

11.282 

339.41 

0.19 

(5)0.0042 

gy ( 0. 0)  ,gg(l  . 571) 

7 

11.313 

2.00 

11.314 

340.00 

0.015 

(0)0.0042 

g7(0.0),g8(1.571) 

8 

11 . 312! 

2.00 

11.314 

340.00 

0.001 

(0)0.0042 

g?(0 . 0) ,gg(l . 571) 

•Maximum  number  of  maximizations 


Table  A Vibration  Isolator  Design,  Case  (1) 
(First  Order  Algorithm) 


iter 

obj . 

1 1 fib1  1 

1 1 1 |max 

tight  constraint ,g(a ) 

0 

0.15 

1.0 

58.5 

29.97 

(6)« .0025 

gl ( . 8675) 

1 

0.15 

0.9965 

55.99 

29.97 

(5)0.0018 

g1(.864) 

2 

0.1502 

0.9926 

53.48 

29.97 

(6)0.0013 

gi(.8665) 

3 

0.1502 

O.9889 

50.98 

29.97 

(5)0.0018 

6l( .863) 

4 

0.1503 

0.9844 

ns. n9 

29.96 

(5)0.0013 

gl ( . 8605) 

5 

0.1504 

0.9799 

45.99 

30.00 

(5)0.0018 

6 

0.1504 

0.9799 

40.00 

29.95 

(5)0.0025 

gl ( • 859) 

7 

0.1508 

0.9636 

37.52 

29.92 

(4)0.0025 

gl ( • 854 ) 

8 

0.1509 

0.9564 

35.03 

30.00 

(4)0.0025 

9 

0.1509 

0.9564 

29.04 

29.92 

(5)0.0025 

gl ( . 854 ) 

10 

0.1512 

0.9352 

26.59 

29.86 

(5)0.0025 

g1(.849) 

11 

0.1513 

0.9237 

24.11 

29.81 

(4)0.0025 

gl ( . 844 ) 

12 

0.15m 

0.9128 

21.65 

29.74 

(5)0.0025 

g1(.839) 

13 

0.1515 

0.9007 

19.10 

9.36 

(4)0.0025 

gl ( • 836) ,g2(l . 067 ) 

in 

0.1739 

0.9074 

20.39 

2.44 

(5)0.0025 

g1(.849),g2(1.052) 

15 

0.1658 

0.9092 

21.00 

2.78 

(4)0.0017 

gl(.846),g2(1.063) 

16 

0.1720 

0.9087 

21.00 

1.02 

(4)0.0025 

g1(.850),g2(1.058) 

17 

0.1706 

0.9089 

21.00 

0.81 

(4)0.0025 

gl( . 846) ,g2(l .053) 

18 

0.1701 

0.9090 

21.03 

0.96 

(4)0.0017 

g1(.849),g2(1.056) 

19 

0.1699 

0.9090 

21.06 

1.12 

(3)0.0015 

gx( .852) ,g2(l .060) 

20 

0.1697 

0.9090 

21.05 

0.97 

(4)0.0015 

g1(.849),g2(1.056) 

Vjl 


Table  5 Vibration  Isolator  Design,  Case  (11) 
(First  Order  Algorithm) 


Iter 

bi 

obj. 

1 1 ab1 1 1 

1 1 fia1 1 !max 

tight  constraint,  Bi(o) 

0 

0.15 

1.0 

37.82 

28.24 

(6)* .0025 

gx(.9) 

1 

0.1499 

0.9955 

35.55 

28.24 

(6)0.005 

g]_(  -9) 

2 

0.1498 

0.9907 

33.20 

28.23 

(6)0.0013 

gl( -9) 

3 

0.1497 

0.9852 

30.85 

28.22 

(4)0.5017 

g-L  ( • 9 ) 

4 

0.1496 

0.9791 

28.50 

28.20 

(4)0.5025 

gl( .9) 

5 

0.1494 

0.9723 

26.16 

28.18 

(4)0.0025 

gx(.9) 

6 

0.1491 

0.9646 

28.82 

28.14 

(4)0.0025 

gx( -9) 

7 

0.1488 

0.9558 

21.49 

28.09 

(5)0.0025 

gx  ( • 9 ) 

8 

0.1484 

0.9453 

19.16 

27.99 

(4)0.0025 

gl  ( • 9 ) 

9 

0.1478 

0.9326 

17.57 

11.11 

(4)0.0025 

gx(. 9)^(1. 093) 

10 

0.1297 

0.9488 

16.68 

5.59 

(5)0.0025 

g1(.9),g1(1.108) 

11 

0.1168 

0.9589 

16.85 

4.44 

(5)0.0017 

g1(.9),g1(1.125) 

12 

0.1262 

0.9517 

16.61 

0.91 

(4)0.0025 

g1(.9),g1(1.120) 

13 

0.1311 

0.9472 

16.71 

5.93 

(4)0.0022 

g1(.9),g1(1.107) 

14 

0.1150 

0.9603 

16.90 

6.65 

(3)0.0015 

g1(.9),g1(1.13),g2(.96) 

15 

0.1180 

0.9587 

16.67 

4.47 

(3)0.0015 

g1(.9),g1(1.13),g2(.943) 

16 

0.1192 

0.9577 

16.64 

0.8(-4) 

(4)0.0015 

g1(.9),g1(1.12),g2(.94) 

17 

0.1221 

0.9552 

16 . 62 

0.93 

(3)0.0013 

g1(.9),g1(1.12),g2(.938) 

18 

0.1227 

0.9547 

16.61 

2.32 

(4)0.0013 

g^ ( *9)  jg^d.12) , g2 (.94) 

19 

0.1233 

0.9541 

16.61 

0.88 

(4)0.0013 

Bl<-9) ,g1(1.12),g2(.94) 

20 

0.1239 

0.9536 

16.61 

0.1(-4) 

(4)0.0013 

gl(  -9)  ^(1.12)  ,g2(  .94) 

VJ1 

CD 


Table  6 Bridge  Design  Problem 
(First  Order  Algorithm) 


Initial  estimate;  b(o)=[3.8,  3-0,  3-0,  3.8,  0.8,  0.8,  3.0,  3.0,  1250. ]T, 

Weight  = 12851*  lbs, 

Constraints  violated;  none. 

Final  design  found: 

b(75)  = C3.228,  2.284,  1.107,  3-527,  1.847,  0.200,  2.340-,  0.200,  1255.0]T, 

Weight  = 11825  lbs, 

Displacement  at  load  P2  = 1.8029"  at  a = 378.8"  (0.16?  violation), 

p 

Design  variables  bg  and  bg  were  at  the  lower  bound  of  0.2  in  . 

The  following  information  regarding  parametric  constraints  is  obtained: 

Maximum  stresses  in  members  1 through  8 are;  -18.9  ksi  at  a = 204", 

18.9  ksi  at  204",  34.6  ksi  at  72.3",  -16.4  ksi  at  396",  18.5  ksi  at  570", 
18.5  ksi  at  0.0",  17.8  ksi  at  234",  and  7.22  ksi  at  440"; 

Maximum  moments  were  187.8  ft-kips  under  load  Pj  at  o * 0"  and  187.7  ft-kips 
under  load  P^  at  785". 
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Figure  6 Main  Mass  Response 
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3.^  Conclusions 

A Tirst  order  algorithm  has  been  developed,  applying 
Kuhn-Tucker  necessary  conditions  to  the  first  order  approx- 
imation of  the  POD  problem.  The  analysis  shows  that  this 
method  is  equivalent  to  alternating  maximization  and  mini- 
mization procedures  for  min-max  problems. 

The  algorithm  implemented  by  the  gradient  projection 
method,  with  constraint  error  compensation,  has  been  applied 
to  four  example  problems  with  no  real  difficulty.  It  was 
experienced  that,  though  the  convergence  is  linear,  the 
method  has  the  general  characteristics  of  the  gradient 
projection  method  applied  to  nonlinear  programming  problems. 
Thus  the  method  appears  to  be  reliably  convergent,  generally 
within  20  iterations. 


APPENPIOES 
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APPENDIX  A 

DYNAMIC  EQUATIONS  FOI>  SECTION  2 . 3 . 'l 


The  dynamic  equation:;  have  been  derLved  in  terms  of 
i."nd  I meuaionallzed  variables  in  f.  32  J . With  specific 
vsiu<>s  for  the  variables  Introduced  there  l See  Figure  3), 
the  mass,  stiffness  and  damping  matrices  are  obtained  as 
1 « li  ow  a : 


jVj  = 


0.25 


0 

1.0 


0 

0 

0.07(163 


(symmetric ) 


o 

o 

0 I S 


I : ’I  J <•,  -0  Jl  : ••  - 0 i h l v 0 


( syminotr  1 •.  ) 


0 

0.15 

0 

-1.09 


2.590  -0.3292  -3.09 

U . 006*1  -0.3033  0.7267 

) ’ 1.  0 


12.12 


0. 6403b,,  -0.6403b, 

0.6403b1+2.697b2+2.697b3, 


(symmetric ) 


0.05336b1 

.004447b], 


•05336b1  , 0,0 

.8989b2-1.7S8b3,  -2.697b2,  -2.697b3 
,2996b  +1.199b3,  -.o989b2,  1.798b 

2.697b2,  0 

2 . 697b 


m 
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and  the  column  force  vector  Is  given  as 

P * { 0,  0,  0,  11.03,  11.03  ) , 

where  b^  , , and  b^  are  the  dimensionless  damping  para- 

meters, which  are  the  design  variables,  lienee,  the  state 
equations  can  be  written,  from  Eqs.  (2.35)  and  (2.37),  as 
fol lows  : 


-a2M  + K 

aD 

f 

u 

ss 

aD 

a2M  - K 

V 

.0, 

where  the  dimensionless  generalized  coordinates 
7.  i X/xq  * u - iv  are  the  state  variables,  and  a * w/a>l0 
is  the  frequency  parameter,  where  is  the  first  undamped 

natural  frequency. 

Therefore,  the  objective  function  introduced  In  the 
text  as  the  souare  of  the  ratio  of  the  amplitude  of  m^  and 
the  base  is  given  by 

*(z)  = u1?  + vx2 . 
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APPENDIX  B 

ANALYSIS  OF  THE  BRIDGE  FOR  SECTION  2.3.6 


Numberinr  the  elements  and  nodes  of  the  truss  struc- 
ture, as  shown  In  Flp.ure  ^a,  extensions  of  the  members,  in 
terms  of  generalized  displacements,  are  obtained:  For 

convenience , let 


^a*+  h7* 


II,  = 


h 


1 ‘ 


B = 


Up  = 7^========= 

^a2  + h2 


el 

ss 

Bu^  - H|V 

2 9 

e2 

= 

u3  ’ 

C 3 

ss 

V3  " V2  ’ 

= 

UH  - u2. 

e5 

= 

Atu^-Ug) 

+ 

ll2(v5"v2), 

e6 

» 

A(u^-u^) 

-f 

WV' 

e? 

3 

u5  " u3 ’ 

CO 

CL* 

= 

v5  ~ VH> 

'J  n 

= 

H ' u4’ 

*'10 

= 

A (Uy~Ujj ) 

+ 

II2(v7"vi1)  * 

°n 

A(u^-u^) 

+ 

H2(Virv6)  ’ 

C12 

= 

u7  " u5 ’ 
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°13  ' v7  " v6 ’ 

C1H  55  b(u8'u6}  " Hlvf,» 

= u8  - u7* 

The  clement  stiffness  matrices  are,  then,  given  by; 


A^E 

-BHj^  ' 

t:r 

-BH]. 

'42. 

A p L* 

A.E 

1 - 

-1 

4 

-1 

1 

A,|E 

1 

-1 

L, 

J| 

l -1 

1 

’ A2 

AH, 

-A2 

-ah2 

a5k 

TT 

V 

-ah2 

-H?2 

s 

A2 

AH  2 

(sym) 

') 

!!;/- 

t 

A 2 

"AH  2 

-A2 

ah2 

a6i-: 

Tv 

2 

•‘2 

AH2 

-Ho2 

c. 

A2 

-AH, 

(sym) 

u 

o 

V 

AjE 

ly 

1 

-1  1 

L -1 

1 

, etc . 
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The  structure  stiffness  matrix  is  obtained  by  combining  the 
element  stiffness  matrices.  This  can  be  done  easily  by  a 
simple  computer  program  with  the  element  stiffness  matrices 
stored.  The  equation  for  the  truss  tructure  can  be  writ- 


ten as 


— 1 

1 

(M 

rH 

« 

q 

a 

0 

LK21 

K22J 

_qb- 

_ -F  _ 

(B.l) 


where  , 

q i {u2,v2,u3,ui),vij  ,u5,u6,v6,u7,ug} , (B.2) 

qb  = {v3,Vtj,Vy},  (B.  3) 

F = {P3,  F5,  Fy} . (B.4) 

For  a more  systematic  approach  of  obtaining  the  stiffness 
matrix  and  the  derivatives  of  the  equations  with  respect 
to  design  variables,  see  [50]. 

Once  the  generalized  displacements  are  obtained. 


axial  stresses  in  the  members  are  given  by  the  formula 

E 

7“  ei> 


CM  = 


(B.5) 


where  the  subscript  i refers  the  i-th  member. 

The  following  analysis  will  determine  the  displace- 
ments at  x = a^ , a2 , and  a^in  terms  of  the  load  P»{P^,  P2) 
and  the  load  F acting  at  the  interacting  boundary.  Using 
the  superposition  principle,  the  displacements  can  be 
written  as 

KIqb  = BP  + CP,  (13. 6) 

where  BF  is  the  contribution  from  F and  CP  is  that  from 
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the  load  P. 

Consider  first  the  case  of  load  P.  Using  the  notation 
of  singularity  functions [^9] , the  load  on  the  beam  is  given 
by 


q(x)  = -Ra<x>_1  + P^<x-a>_^  + P2<X-a-i>_i 
-R^cx-d  . 

By  integration,  the  shear  force  is. 


-V(  x ) 


-Hft<x>°  + P1<x-a>°  + P0<x-a-£>°  - RB<X-d>°, 


'A  ‘ ‘ I'-"-'  - 1 2 

and  integrating  again,  the  moment  is, 

M(x)  = -R^<x>*  + P^<x-a>^  + P2<x-a-£>^. 

From  the  load  conditions  at  the  end, 

-vu>|x=d+  - 0 = -Ra  + Pl  + p2  - rb 

M(x)  |xi!d+  - 0 = -RAd  + P^ (d-a ) + P2(d-o-t) 
Hence  solving  for  RA  and  Rg, 

Ra  - (Pi(d-a)  + P2(d-a-£)}/d, 

Rr  * {Pja  + P2(a+i)}/d. 

Now,  the  beam  equation  is  given  by 

HI  = M(x ) 

dx^ 


(B.  7 ) 


(B.  8) 
(B.9) 

(B.10) 


where,  v is  the  vertical  displacement  at  x.  After  sub- 
stituting M ( x ) from  Eq . (B.7)  and  integrating, 

EIv  = ^_Rax3  + Pi<x-“>3  + P2<x-a-i>33 


+c^x  + C2« 

From  the  boundary  conditions,  i.e., 
v|xa0  - 0,  and  v|xa,d  ■= 


(B.ll) 


0, 
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one  has 

c1  = - ^[-RAd3+P1(d-a)3+P2(d-a-t)3], 


(B . 12 ) 


c 2 = 0 . 


Therefore,  the  vertical  displacements  v^,  v^,  and  v^;  at 
x=a^  , a^ , and  a^;  are  obtained  as 

EIv^  = ^[-RAa1^+p^<aj-o>^+P2<a^-a-£>^]  + c^a^, 

EIvr  = ^•[-RAa2^+P-L<a?-a> 3+P2<a2-a-£> 3]  + c-j^, 

Elvy  = g-C-R^a^+P-^a^-c^  3+P2<a^-a-£> 3]  + c^a-j. 

The  elements  of  C are  obtained  as: 

C(i,.D  = (d2a1-a13)  (d-y^  J-aj^  (d-y1  )^+d<a1-yj>  ^]  , 

(1  = 1, 2, 3,  and  J*l,2),  (B.13) 

where  .Vj  = a,  and  y2=a+i, . In  the  case  of  k loads  P^  i«l,***, 
k,  it  is  only  necessary  to  define  y^  as  positions  of  load 
applications . 

For  the  load  , F^,  and  F^ , the  matrix  is  simply 
obtained  by  putting  a=a^,  a2 , and  a^,  cyclically,  into  the 
first  column  of  the  above  expression.  It  is  noted  that, 
in  this  case,  Maxwell's  law  of  reciprocity  is  applied  and 
the  matrix  B is  symmetric.  The  matrix  B is  obtained  as: 

= ^-[  (d2a1-a13)  (d-aj  )-a1  (d-a^ ) 3]  , 

(J  ,j-l,2,3;  iiJ).  (B.lH) 

Since  F is  assumed  as  an  unknown  generalized  force, 
one  can  write 


K 


K 


11 

21 

0 


K 


K 


12 


0 

22  1 
I -B/EI 


q 

0 

.O 

cr 

0 

F 

CP/EI 

(B. 15) 
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which  is  the  desired  state  equation,  with  the  state 
variable  vector 

z = {q,  qb,  F)  . ( B - 1 6 ) 

Since  B Is  a constant  matrix,  the  following  form  is 
comnutationally  more  efficient ; 


K11 

K12 

f > 

q 

S 

0 

,K12 

Kpp+EIB"*1 

qb. 

B -1CP 

^ * 

F « EIB-1qb  - B'1CP.  (B.18) 

In  the  text , bending  moment  and  displacement  of  the 
beam  are  needed.  For  the  beam  under  consideration,  they 
are  easily  found  as 

M(x)  = ~rax  + Ri<x_a>1  + P2<x“a“A>‘*' 

+F^<x-a1>1+  F^<x-a2>1  + Fy<x-a^>1,  (B.19) 

and 

EIv  » g-[-R^x3  + P-^<x-a>3  + Pp<x-a-i>3  + F3<X-a^>^ 

+F^<x-a2>^  + F7<x-a3>3]  +c1x,  (B.20) 

where 

Ra  = [Pi(d-a)  + P2(d-a-£)  + F3(d-a1)  + F5(d-a2) 

+F?(d-a3)]/d  (B . 21 ) 

C1  = -t“RAd3  + pl(d“a)3  + P2(d-“-t)3  + F3<d-a1)3 

+F5(d-a2)3  + F7(d-a3)3]/6d.  (B.22) 

It  is  noted  that  the  maximum  bending  moment  occurs  at  the 
point  of  load  application.  Hence  the  moment  constraint 
is  imposed  at  the  discrete  points  of  load  application. 

For  example,  at  x=a^,  the  constraint  can  be  written 
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from  Eq  . (D. 19) 

| -K^Sj,  + P^<a-L-a>1  + P2<a^-a-fc>1|  - 0 . 580 yl ^VsF  < 0. 

(B.23) 

Displacement  constraints  will  be  imposed  under  a specified 
axle  of  the  vehicle,  say  the  front  axle.  Then,  from  Eq. 

(B . 20 ) , 

|C-RAa^  + F^<a-a1>^  + F^<a-a2>^  + . 

H-Cj^al  - EI6  <_  0,  (B.2M) 

where  6 is  a preassigned  number.  If  the  displacement 
constraint  at  the  center  is  imposed,  the  expression  is 

I I - «c  i o,  (B.25) 

where  6 is  a constant, 
c 

For  the  numerical  calculations  given  in  the  text,  the 
following  data  are  chosen: 

E = 3-107  lbs/in2 
p = «*  0.2836  lbs/in^ 

r h n 

-o c=  oT  = Oy  “ 3.6*10  lbs/in^ 
a = b = h = 30  ft 
lx-  1^4  ft 
i2=  H2  ft 
Px  = 8000  lbs 
P?  = P3  = 32000  lbs 
6 = 6 c = 1.8  in. 
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APPENDIX  C 

CONVEXITY  AND  SOME  TERMINOLOGY  FROM 
FUNCTIONAL  ANALYSIS 


A set  K in  a linear  vector  space  is  said  to  be  convex, 
if,  Riven  x,  y e K,  all  points  of  the  form  Ax+(1-A)y,  with 
0<_A  <_1 , are  in  K.  The  convex  hull  of  a given  subset  S In  a 
linear  vector  space  is  the  smallest  convex  set  containing 
S,  and  is  denoted  by  co  S.  A set  C in  a linear  vector 
space  is  said  to  be  a cone  with  vertex  at  the  origin  if 
xeC  Implies  AxeC  for  all  A>0. 

For  a full  discussion  of  convexity,  the  reader  is  re- 
ferred to  [^1]. 

Consider  a normed  linear  space  X.  A linear  functional 
f on  X is  bounded  if  there  is  a constant  M such  that 
| f ( x ) | < M | | x | | , for  all  xeX.  The  normed  dual  of  X,  denoted 
by  X*  Is  defined  as  the  set  of  all  bounded  linear  function- 
als on  X.  The  elements  of  X*  are  denoted  by  letters  with  an 
asterisk,  e.g.,  x*,  y#,  etc.  The  addition  of  functionals 
and  multiplication  by  numbers  are  defined  as  follows: 

(x*  + y*)(x)  * x*(x)  + y*  (x ) 

(Ax*)(x)  » Ax* (x ) 

Then,  X*  is  a normed  linear  space  (actually  a Banach  space) 
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with  the  norm 

| |x* | | = sun  |x*(x) | . 

I |x|  |£l 

Hence  the  set 

V(B,r,x£)  = {x*eX*  | sup  | x* (x )-x* (x ) | <r } , 

xeB  ° 

where  B is  any  bounded  subset  of  X,  is  an  open  set  in  the 
strong  topology  in  X*.  The  weak*  topology  may  be  defined 
by  the  class  of  open  sets; 

S(x,r,x*)  = (x*eX*  | |x*(x)-xj(x) | <r } , 

for  all  x's,  x*'s,  and  r's.  Therefore,  on  X*,  each  term, 
such  as  closure,  convergence,  and  compactness,  has  two 
meanings , depending  on  whether  the  strong  or  the  weak* 
topology  is  under  consideration.  It  may  be  verified  that 
the  strong  convergence  of  a sequence  of  functionals  x^  to 
x*  implies  weak*  convergence,  and  if  a set  is  weak*  closed, 
then  it  is  also  strongly  closed.  For  more  details,  refer 
to  [6,23,51]. 
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